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(57) An implementation of a technology is described 
herein for deriving robust non-local characteristics and 
quantizing such characteristics for blind watermarking 
of a digital good. This technology finds the proper bal- 
ance between minimizing the probability of false alamris 
(i.e., detecting a non-existent watemiark) and the prob- 
ability of misses (i.e., failing to detect an existing water- 
mark). The technology, described herein, perfonns 
quantization index modulation (QIM) based upon non- 
local characteristics of the digital good. Non-local char- 
acteristics may include statistics (e.g., averages, medi- 
an) of a group of individual parts (e.g., pixels) of a digital 
good. This abstract itself is not intended to limit the 
scope of this patent. The scope of the present invention 
is pointed out in the appending claims. 
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Description 
TECHNICAL FIELD 

5 [0001] This invention generally relates to a technology for deriving robust non-local characteristics and quantizing 
such characteristics for blind watemnarking of a digital good. 

BACKGROUND 

10 [0002] "Digital goods" Is a generic label for electronically stored or transmitted content. Examples of digital goods 
include images, audio clips, video, digital film, muttimedia, software, and data. Digital goods may also be called a 
"digital signal," "content signal," "digital bitstream," "media signal," "digital object," "object," and the like. 
[0003] Digital goods are often distributed to consumers over private and public networks — such as Intranets and the 
Internet. In addition, these goods are distributed to consumers via fixed computer readable media, such as a compact 

^5 disc (CD-ROM), digital versatile disc (DVD) , soft magnetic diskette, or hard magnetic disk (e .g, , a preloaded hard drive) . 
[0004] Unfortunately, it is relatively easy for a person to pirate the pristine digital content of a digital good at the 
expense and hamn of the content owners — which includes the content author, publisher, developer, distributor, etc. 
The content-based industries (e.g., entertainment, music, film, etc.) that produce and distribute content are plagued 
by lost revenues due to digital piracy. 

20 [0005] Modem digital pirates effectively rob content owners of their lawful compensation. Unless technology provides 
a mechanism to protect the rights of content owners, the creative community and culture will be impoverished. 

Watermarking 

25 [0006] Watenmarking is one of the most promising techniques for protecting the content owner's rights of a digital 
good (i.e., digital good). Generally, watemnarking is a process of altering the digital good such that its perceptual char- 
acteristics are preserved. More specifically, a "watemnark" is a pattern of bits inserted into a digital good that may be 
used to identify the content owners and/or the protected rights. 

[0007] Watemnarks are designed to be icompletely invisible or, more precisely, to be imperceptible to humans and 
30 statistical analysis tools. Ideally, a watermarked signal is perceptually identical to the original signal. 

;[0008] A watermark embedder (i.e., encoder) embeds a watermark into a digital good. It typically uses a secret key 
to embed the watennark. A watennark detector (i.e., decoder) extracts the watennark from the watemnarked digital 
good. 

35 Blind Watemnaricing 

[0009] To detect the watermaric, some watemnarking techniques require access to the original unmarked digital good 
or to a pristine specimen of the marked digital good. Of course, these techniques are not desirable when the watermark 
detector is available publicly. If publicly available, then a malicious attacker may get access to the original unmarked 
40 digital good or to a pristine specimen of the marked digital good. Consequently, these types of techniques are not used 
for public detectors. 

[0010] Alternatively, watennarking techniques are "blind." This means that they do not require access to the original 
unmarked digital good or to a pristine specimen of the marked digital good. Of course, these "blind" watennarking 
techniques are desirable when the watermark detector is publicly available. 

45 

Robustness 

[0011] Before detection, a watemnarked signal may undergo many possible changes by users and by the distribution 
environment. These changes may include unintentional modifications, such as noise and distortions. Moreover, the 
50 marked signal is often the subject of malicious attacks particularly aimed at disabling the detection of the watermaric. 
[0012] Ideally, a watemiaricing technique should embed detectible watemnarks that resist modifications and attacks 
as long as they result in signals that are of perceptually the same quality. A watennarking technique that is resistant 
to modifications and attacks may be called "robust." Aspects of such techniques are called "robust" if they encourage 
such resistance. 

55 [0013] Generally speaking, a watennarking system should be robust enough to handle unintentional noise introduc- 
tion into the signal (such noise my be introduced by A/D and D/A conversions, compressions/decompressions, data 
corruption during transmission, etc.) 

[0014] Furthemnore, a watennari<ing system should be robust enough and stealthy enough to avoid purposeful and 
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malicious detection, alternation, and/or deletion of the watermark. Such an attack may use a "shotgun" approach where 
no specific watemnark is known or detected (but is assumed to exist) or may use "sharp-shooter" approach where the 
specific watemnark is attacked. 

[0015) This robustness problem has attracted considerable attention. In general, the existing robust watermark tech- 
5 niques fall into two categories: spread-spectrum and quantization index modulation (QIM). 

[0016] With the spread spectrum-type techniques, the watermark indexes the modification to the host data. The host 
data is the data of the original, unmarked digital signal (i.e., host signal). With typical spread-spectrum watennarking, 
each bit (e.g., Os and 1s) of the watemnark is embedded into the signal by slightly changing (e.g., adding a pseudor- 
andom sequence that consists of +A or +A) the signal. 
10 [0017] With quantization index modulation (QIM), the watemiark is embedded via indexing the modified host data. 
The modified host data is the data of the marked digital signal (i.e., marked host signal). This is discussed in more 
detail below. 

[0018] Those of ordinary skill in the art are familiar with conventional techniques and technology associated with 
watermarks, watermark embedding, and watermark detecting. In addition, those of ordinary skill in the art are familiar 
IS with the typical problems associated with proper watermark detection after a marked signal has undergone changes 
(e.g., unintentional noise and malicious attacks). 

Desiderata of Watermarking Technology 

20 [0019] Watemnarking technology has several highly desirable goals (i.e., desiderata) to facilitate protection of cop- 
yrights of content publishers. Below are listed several of such goals. 

Perceptual Invisibility . 

25 [0020] The embedded information should not induce perceptual changes in the signal quality of the resulting water- 
marked signal. The test of perceptual invisibility is often called the "golden eyes and ears" test. 

Statistical Invisibility . 

30 [0021] The embedded information should be quantitatively imperceptiveforany exhaustive, heuristic, or probabilistic 
attempt to detect or remove the watemnark. The complexity of successfuJIy launching such attacks should be well 
beyond the computation power of publicly available computer systems. Herein, statistical invisibility is expressly in- 
cluded within perceptual invisibility. 

35 Tamperproofness . 

[0022] An attempt to remove the watemnark should damage the value of the digital good well above the hearing 
threshold. 

40 Cost . 

[0023] The system should be inexpensive to license and implement on both programmable and application -specific 
piatfomns. 

45 Non-disclosure of the Original . 

[0024] The watemnarking and detection protocols should be such that the process of proving digital good content 
copyright both in-situ and in-court, does not involve usage of the original recording. 

50 Enforceability and Flexibility. 

[0025] The watemnarking technique should provide strong and undeniable copyright proof. Similarly, it should enable 
a spectrum of protection levels, which correspond to variable digital good presentation and compression standards. 

55 Resilience to Common Attacks. 

[0026] Public availability of powerful digital good editing tools imposes that the watermarking and detection process 
is resilient to attacks spawned from such consoles. 
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False Alarms & Misses 

[0027] When developing a watemnarking technique, one does not want to increase the probability of a false alami. 
That Is when a watermark is detected, but none exists. This is something like finding evidence of a crime that did not 
5 happen. Someone may be falsely accused of wrongdoing. 

[0028] As the probability of false alanns increases, the confidence in the watermarking technique decreases. For 
example, people often Ignore car alanns because they know that more often than not It is a false alamri rather than an 
actual car theft. 

[0029] Likewise, one does not want to increase the probability of a miss. This is when the watermark of a signal is 
10 not properly detected. This is something like overlooking key piece of evidence at a crime scene. Because of this, a 
wrongdoing may never be properly investigated. As the probability of misses increases, the confidence in the water- 
marking technique decreases. 

[0030] Ideally, the probabilities of a false alarm and a miss are zero. In reality, a compromise is often made between 
them. Typically, a decrease in the probability of one increases the probability of the other. For example, as the probability 
15 of false alamn Is decreased, the probability of a miss increases, 

[0031] Consequently, a watermarking technique is needed that minimizes both while finding a proper balance be- 
tween them. 

Quantization Index Modulation (QIM) 

20 

[0032] To that end, some have proposed embedding a watemnark by indexing the signal (e.g., host data) during the 
watermark embedding. This technique is called quantization index modulation (QIM) and it was briefly introduced 
above. 

[0033] In general, quantization means to limit the possible values of (a magnitude or quantity) to a discrete set of 
25 values. Quantization may be thought of as a conversion from non-discrete (e.g., analog orcontinuous) values to discrete 
values. Alternatively, it may be a conversion between discrete values with differing scales. Quantization may be ac- 
complished math ematically,th rough rounding or truncation. Typical QIM refers to embedding infomnation by first mod- 
ulating an index or sequence of indices with the embedded infomnation and then quantizing the host signal with the 
associated quantizer or sequence of quantizers. A quantizer is class of discontinuous, approximate-identity functions. 
30 [0034] The major proponentof such QIM techniques is Brian Chen and Gregory W. Worneii (i.e., Chen-Wornell). In. 
their words, they have proposed, "dither modulation in which the embedded infomnation modulates a dither signal and 
the host signal is quantized with an associated dither quantizer" (from Abstract of Chen-Womell article from the IEEE 
Trans. Inform. Theory^, 

[0035] See the following documents for more details on Chen-Womell's proposals and on QIM: 

35 

• B. Chen and G.W. Womell, "Digital watermarking and infomnation embedding using dither modulation," Pmc. IEEE 
Workshop on Multimedia Signal Processing, Redondo Beach, CA, pp. 273-278, Dec. 1 998; 

• B. Chen and G. W. Womell, "Dither modulation: a new approach to digital watermarking and information embed- 
ding," Proc. ofSPIE: Security and Watermarking of Multimedia Contents, vol. 3657, pp. 342-353, 1999; 

40 • B. Chen and G. W. Wornell, "Quantization index Modulation: A class of Provably Good Methods for Digital Water- 
maricing and Infomnation Embedding," IEEE Trans. Inform. Theory, 1999 and 2000. 

Limitations of Conventional QIM 

45 [0036] However, a key problem with conventional QIM is that It is susceptible to attacks and distortions. Conventional 
QIM relies upon local characteristics within relative to specific representation of a signal (e.g., in the time or frequency 
domain). To quantize, conventional QIM relies exclusively upon the values of "individual coefficients" of the represen- 
tation of the signal. An example of such, an "individual coefficients" Is the color of an individual pixel of an image. 
[0037] When quantizing, only the local characteristics of an "individual coefficient" are considered. These local char- 
so acteristics may include value (e.g., color, amplitude) and relative positioning (e.g., positioning in time and/or frequency 
domains) of an individual bit (e.g., pixel). 

[0038] Modifications — from either an attack or some type of unintentional noise — can change local characteristics 
of a signal quite dramatically. For example, these modifications may have a dramatic affect on the color of a pixel or 
the amplitude of a bit of sound. However, such modifications have little effect on non-local characteristics of a signal. 
55 / [0039] Accordingly, a new and robust watermarking technique is needed to findthe proper balance between mini- 
mizing the probability of false alanns and the probability of misses, such as QIM watemnarking techniques. However, 
such a technique is needed that is less susceptible to attacks and distortions to the local characteristics within a signal. 
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SUMMARY 

[0040] Described herein is a technology for deriving robust non-local characteristics and quantizing such character- 
istics for blind watennarking of a digital good. 
5 [0041] This technology finds the proper balance between mininnizing the probability of false alanns (i.e., detecting a 
non-existent watermark) and the probability of nnisses (i.e., failing to detect an existing waternnark). One possible tech- 
nique is quantization index modulation (QIM) watermarking. However, conventional QIM is susceptible to attacks and 
distortions to the local characteristics of a digital good. 

[0042] The technology, described herein, performs QIM based upon non-local characteristics of the digital good. 
10 Non-local characteristics may include statistics (e.g., averages, nnedian) of a group of Individual parts (e.g., pixels) of 
a digital good. 

[0043] This summary itself is not intended to limit the scope of this patent. Moreover, the title of this patent is not 
intended to limit the scope of this patent. For a better understanding of the present invention, please see the following 
detailed description and appending claims, taken in conjunction with the accompanying drawings. The scope of the 
15 present invention is pointed out In the appending claims. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0044] The same numbers are used throughout the drawings to reference like elements and features. 
20 [0045] Fig. 1 Is a schematic block diagram showing a watemnarking architecture in accordance with an implemen- 
tation of the invention claimed herein. 

[0046] Fig. 2 is a schematic block diagram showing an embodiment (e.g., a watemriark embedding system) of the 
Invention claimed herein. 

[0047] Fig. 3 is a flow diagram showing an illustrative methodological implementation (e.g., watenmark embedding) 
25 of the invention claimed herein. 

[0048] Fig. 4 is a schematic block diagram showing an embodiment (e.g., a watemiark detecting system) of the 
invention claimed herein, x -uis 

[0049] Fig. 5 is a flow diagram showing an illustrative methodological implementation (e.g., watennark detecting) of 
the invention claimed herein.; . 

30 [0050] Fig. 6 is an example of a computing operating environment capable of implementing an implementation (wholly 
or partially) of the invention claimed herein. ; 

DETAILED DESCRIPTION . 

'J, 

35 [0051] In the following description, for purposes of explanation, specific numbers, materials and configurations are 
set forth in order to provide a thorough understanding of the present invention. However, it will be apparent to one 
skilled in the art that the present Invention may be practiced without the specific exemplary details. In other instances, 
well-known features are omitted or simplified to clarify the description of the exemplary implementations of present 
invention, thereby better explain the present invention. Furthenmore, for ease of understanding, certain method steps 

40 are delineated as separate steps; however, these'separately delineated steps should not be construed as necessarily 
order dependent in their perfonnance. 

[0052] The following description sets forth one or more exemplary implementations of a Derivation and Quantization 
of Robust Non-Local Characteristics for Blind Watemnarking that incorporate elements recited in the appended claims. 
These implementations are described with specificity in order to meet statutory written description, enablement, and 
45 best-mode requirements. However, the description itself is not intended to limit the scope of this patent. 

[0053] The inventors Intend these exemplary implementations to be examples. The inventors do not intend these 
exemplary implementations to limit the scope of the claimed present invention. Rather, the inventors have contemplated 
that the claimed present Invention might also be ernbodied and implemented in other ways, in conjunction with other 
present or future technologies. 

50 [0054] An example of an embodiment of a Derivation and Quantization of Robust Non-Local Characteristics for Blind 
Watemnarking may be refen^ed to as "exemplary non-local QIM watemnaricer." 

Incorporation by Reference 

55 [0055] The following co-pending patent applications are incorporated by reference herein (which are all assigned to 
the Microsoft Corportaion): 

• U.S. Patent Application Serial No. 09/390271 , entitled "A Technique for Watermari<ing an Image and a Resulting 
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Watermarked' Image" filed Sept. 7, 1 999; 

• U.S. Patent Application Serial No. 09/390272, entitled "A Technique for Detecting a Watemriarl<in a Marked image" 
filed on Sept. 7, 1999; 

• U.S. Patent Application Serial No. 09/614,660, entitled "Improved Stealthy Audio Watermarl<ing*' filed on July 
12,2000,; and 

• U.S. Patent Application Serial No. 09/316,899, entitled "Audio Watennarking with Dual Watermarks" filed on May 
22, 1999. 

Introduction 

[0056] The one or more exemplary implementations, described herein, of the present claimed Invention may be 
implemented (in whole or in part) by a non-local QIM watennarking architecture 1 00 and/or by a computing environment 
like that shown in Fig. 6. 

[0057] In general, the exemplary non-local QIM watermarker derives robust non-local characteristics of a digital 
good. It quantizes such characteristics for blind watennarking of the digital good. 

[0058] The exemplary non-local QIM watermarker minimizes the probability of false alarms (i.e., detecting a non- 
existent watennark) and the probability of misses (i.e., failing to detect an existing watemnark). It does so by employing 
quantization index modulation (QIM) watennarking. However, it does not employ conventional QIM techniques because 
they are susceptible to attacks and distortions to the local characteristics of a digital good. 

■Local Characteristics 

[0059] Conventional QIM relies upon local characteristics within a signal (i.e., a digital good). To quantize, conven- 
tional QIM relies exclusively upon the values of "individual elements" of the host signal. When quantizing, only the local 
characteristics of an "individual element" are considered. These local characteristics may include value (e.g., color, 
amplitude) and relative positioning (e.g., positioning in time and/or frequency domains) of an individual bit (e.g., pixel). 
[0060] Modifications — from either an attack or unintentional noise — can change local characteristics of a signal quite 
dramatically. For example, these modifications may have a dramatic affect on the color of a pixel or the amplitude of: 
a bit of sound. However, such modifications have little effect on non-local characteristics of a signal. 

't-T- 

N on-Local Characteristics : h-- 

[0061] Non-local characteristics are representative of general characteristics of a group or collection of individual 
elements. Such a group may be called a segment. Non-loca! characteristics are not representative of the individual 
local characteristics of the individual elements; rather, they are representative of the group (e.g., segments) as a whole. 
[0062] The non-iocal characteristics may be detennined by a mathematical or statistical representation of a group. 
For example. It may be an average of the color values of all pixels in a group. Consequently, such non-local charac- 
teristics may also be called "statistical characteristics." Local characteristics do not have statistical characteristics be- 
cause a fixed value for a given category. Thus, no statistics are derived from a single value. 

[0063] The non-loca! characteristics are not local characteristics. They are not global characteristics. Rather, they 
are in between. Consequently, they may also be called "semi-global" characteristics. 

Brief Overview 

[0064] Given an original, unmarked good, the exemplary non-local QIM watermarker derives robust characteristics 
that are not local in nature. For example, the exemplary non-local QIM watennarker may employ randomized non- 
Invertible transfomns to produce robust non-local characteristics that can be modified without perceptual distortion. 
These characteristics are typically represented statistically and/or mathematically. 

[0065] To embed the watennark, the exemplary non-local QIM watermarker perfonns quantization of these non-local 
characteristics in one or more dimensional lattices or vector spaces. The marked good that results from the exemplary 
non-local QIM watennari<er is robust against unintentional and intentional modifications (e.g., malicious attacks). Ex- 
amples of malicious attacks include de-synching, random bending, and many other benchmaric attacks (e.g., Stinnaric 
attacks). 

Exemplary Non-Local QIM Watermarking Architecture 

[0066] Fig. 1 shows a digital goods production and distribution architecture 100 (i.e., non-local QIM watennarking 
architecture 100) having a content producer/provider 122 that produces original content and distributes the content 
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over a network 1 24 to a client 126. The content producer/provider 122 has a content storage 130 to store digital goods 
containing original content. The content producer 1 22 has a watennark embeddi ng systenn 1 32 to sign the digital signals 
with a watenmark that uniquely identifies the content as original. The watermark ennbeddlng systenn 132 may be inn- 
plennented as a standalone process or incorporated into other applications or an operating systenn. 
5 [0067] The watermark embedding system 1 32 applies the watemnark to a digital signal from the content storage 1 30. 
Typically, the watennark identifies the content producer 122, providing a signature that is embedded in the signal and 
cannot be cleanly removed. 

[0068] The content producer/provider 1 22 has a distribution server 1 34 that distributes the watermarked content over 
the network 124 (e.g., the Internet). A signal with a watemnark embedded therein represents to a recipient that the 
10 signal is being distributed in accordance with the copyright authority of the content producer/provider 122. The server 
134 may further compress and/or encrypt the content conventional compression and encryption techniques prior to 
distributing the content over the network 124. 

[0069] Typically, the client 126 Is equipped with a processor 140, a memory 142, and one or more content output 
devices 144 (e.g., display, sound card, speakers, etc.). The processor 140 runs various tools to process the marked 

15 signal, such as tools to decompress the signal, decrypt the date, filter the content, and/or apply signal controls (tone, 
volume, etc.). The memory 142 stores an operating system 150 (such as a Microsoft® Windows 2000Cg) operating 
system), which executes on the processor. The client 126 may be embodied in many different ways, including a com- 
puter, a handheld entertainment device, a set-top box, a television, an appliance, and so forth. 
[0070] The operating system 1 50 implements a client-side watermark detecting system 1 52 to detect watermarks in 

20 the digital signal and a content loader 154 (e.g., multimedia player, audio player) to facilitate the use of content through 
the content output device(s) 1 44. If the watennark Is present, the client can identify Its copyright and other associated 
infomnatlon. 

[0071] The operating system 150 and/or processor 140 may be configured to enforce certain rules imposed by the 
content producer/provider (or copyright owner). For instance, the operating system and/or processor may be configured 
25 to reject fake or copied content that does not possess a valid watennark. In another example, the system could load 
unverified content with a reduced level of fidelity. 

Exemplary Non-Locai QIM Watermark Embedding System 

30 [0072] Fig. 2 shows an exemplary* non-local QtM watennark embedding system 200, which is an example of an 
embodiment of a portion of the non-local QIM watemnarking architecture 100. This system may be employed as the 
watermari< encoding system 132 of Fig. 1 . 

[0073] The watermark embedding system 200 includes an amplitude nonnalizer 21 0, a transfomier 220, a partitioner 
230, segment-statistics calculator 240,.a segment quantizer 250, a delta-sequence finder 260, and a signal marker 270. 
35 [0074] The amplitude nonnalizer 210 obtains a digital signal 205 (such as an audio clip). It may obtain the signal 
from nearly any source, such as a storage device or over a network communications link. As its name implies, it 
nonnalizes the amplitude of the signal. 

[0075] The transfonmer 220 receives the amplitude-nonnalized signal from the normallzer 21 0. The transformer 220 
puts the signal in canonical fonn using a set of transformations. Specifically, discrete wavelet transfonnation (DWT) 
40 may be employed (particularly, when the input is an image) since it compactly captures significant signal characteristics 
via time and frequency localization. Other transformations may be used. For instance, shift- invariant and shape-pre- 
serving "complex wavelets" and any overcomplete wavelet representation or wavelet packet are good candidates (par- 
ticularty for images). 

[0076] The transfomner 220 also finds the DC subband of the initial transfonnation of the signal. This DC subband 
45 of the transformed signal is passed to the partitioner 230. 

[0077] The partitioner 230 separates the transfomned signal into multiple, pseudorandomly sized, pseu do randomly 
positioned, adjacent, non-contiguous segments (i.e., partitions). A secret key K\s the seed for pseudorandom number 
generation here. This same K may be used to reconstruct the segments by an exemplary non-local QIM watennari< 
detecting system 400. 

50 [0078] For example, if the signal is an image, it might be partitioned into two-dimensional polygons (e.g., rectangles) 
of pseudorandom size and location. In another example. If the signal is an audio clip, a two-dimensional representation 
(using frequency and time) of the audio clip might be separated into two-dimensional polygons (e.g., triangles) of 
pseudorandom size and location. 

[0079] In this implementation, the segments do not overlap. They are adjacent and non-contiguous. In alternative 
55 implementations, the segments may be overlapping. 

[0080] For each segment, the segment-statistics calculator 240 calculates statistics of the multiple segments gen- 
erated by the partitioner 230. Statistics for each segment are calculated. These statistics may be, for example, any 
finite order moments of a segment. Examples of such include the mean, the median, and the standard deviation. 
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[0081 ] Generally, the statistics calculations for each segment are independent of the calculations of other segments. 
However, other alternatives may involve calculations dependent on data from multiple segments. 
[0082] A suitable statistic for such calculation is the mean (e.g., average) of the values of the individual bits of the 
segment. Other suitable statistics and their robustness are discussed In Venkatesan, Koon, Jakubowski, and Moulin, 
5 "Robust image hashing," Proc. IEEE ICIP2000, Vancouver, Canada, September 2000. In this document, no infonnation 
embedding was considered, but similar statistics were discussed. 

[0083] For each segment, the segment quantizer 250 applies a multi-level (e.g., 2, 3, 4) quantization (i.e., high- 
dimensional, vector-dimensional, or lattice-dimensional quantization) on the output of the segment-statistics calculator 
240 to obtain quantitized data. Of course, other levels of quantization may be employed. The quantizer 250 may be 

10 adaptive or non-adaptive. 

[0084] This quantization may be done randomly also. This may be called randomized quantization (or randomized 
rounding). This means that the quantizer may randomly decide to round up or round down. It may do it pseudorandomly 
(using the secret key). This adds an additional degree of robustness and helps hide the watemnark. 
;[0085] The delta-sequence finder 260 finds a pseudorandom sequence Zthat estimates the difference (i.e., delta) 

15 between the original transfonned signal Xand the combination of segments of quantized statistics. The pseudorandom 
sequence Zmay also be called the delta-sequence. For example, if the statistic is averaging, then Zs.t. Avgj(X -»- 2) = 
Avg,(X) = (if, where X is the marked signal and is average for a segment. 

[0086] When finding a delta-sequence Z, ft is desirable to minimize the perceptual distortion; therefore, some per- 
ceptual distortion metrics may be employed to create this sequence. Thus,^n creating Zfor, the criteria may include a 
20 combination of that minimizes the visual distortions on X+ Z (compared to X) and minimizes the distance between the 
statistics o1 X + Z and quantized statistics of X. ^ 

[0087] The signal marker 270 marks the signal with delta-sequence Zso that X-X+Z. The signal marker may mark 
the signal using QIM techniques. This marked signal may be publicly distributed to consumers and clients. 
[0088] The functions of aforementioned components of the exemplary no n- local QiM watermark embedding system 
25 200 of Fig. 2 are explained in more detail below. 

Methodological Implementation of the Exemplary.;Non-Local QIM Watermark Embedding 

[0089] Fig. 3 shows the methodological Implementation of the exemplary non-local QIM watemnark embedding sys- 
30 tern 200 (or some portion thereof). More specifically, this figure shows the methodological implementation of watennark 
embedding of the exemplary non-local QIM watemnarker. This methodological implementation may be perfonned in 
software, hardware, or a combination thereof. ^ ^ 

i[0090] At 31 0 of Fig. 3, the exemplary non-local QIM watermarker normalizes the amplitude of the input. The input 
is the original, unmarked signal (i.e., digital good). AXS^2, it finds a transfonn of the amplitude-normalized signal and 
35 gets the lowest frequency band (e.g., the DC subband). The result of this block is a transformed signal. This transfor- 
mation is a discrete wavelet transformation (DWT), but most any other similar transfomnation may be perfonned in 
alternative implementations. 

[0091] At 31 4, the exemplary non-local QIM watermarker partitions the transformed signal into multiple, pseudoran- 
domly sized, pseudorandomly positioned, adjacent, non-contiguous segments. A secret key Kis the seed for pseu- 
40 dorandom number generation here. This same Kmay be used to reconstruct the segments in the watermark detecting 
process. 

[0092] For example, if the signal is an image, it might be separated into two-dimensional polygons (e.g., rectangles) 
of pseudorandom size and location. In another example, if the signal is an audio clip, a two-dimensional representation 
(using frequency and time) of the audio clip might be separated. into two-dimensional polygons (e.g., trapezoids) of 
45 pseudorandom size and location. 

'[0093] In this implementation, the segments do not overiap. They are adjacent and non-contiguous. In alternative 
implementations, the segments may be overlapping, 

[0094] For each segment of the signal, the exemplary non-local QIM watemnarker repeats blocks 320 through 330. 
Thus, each segment is processed in the same manner. 
50 [0095] At 322 of Fig. 3, the exemplary non-local QIM watemnarker has a watemnark (or a portion thereof) to embed 
in the curent segment. It finds quantized values of statistics of the segment (e.g., averages within the segment or as 
close as possible). At this point, scalar unifonm quantizer and reconstruction points may be randomly perturtDed with 
Kas the seed. 

[0096] At 324, the exemplary non-local QIM watemiarker finds a pseudorandom sequence Z where the statistics 
55 calculation (e.g., averaging) of this sequence combined with the segmented signal generates the calculation of water- 
mari<ed signal segment. This is also equal to the quanitized statistics of the signal segment. 

[0097] At 330, the process loops back to 320 for each unprocessed segment. If all segments have been processed, 
then it proceeds to 340. 
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[0098] At 340 of Fig. 3, the exemplary non-local QIM watermarker connbines the pseudorandonn sequence with the 
signal segments to get the watermarked signal segments. In addition, the watennarked signal segments are combined 
to form a full watermarked signal. In other words, X= X+ Z. At 350, the process ends. 

5 Exemplary Non-Local QIM Watermark Detecting System 

[0099] Fig. 4 shows an exemplary non-local QIM watermark detecting system 400, which is an example of an em- 
bodiment of a portion of the non-local QIM watermarking architecture 100. This system may be employed as the wa- 
temnark detecting system 152 of Fig. 1 . 
10 [0100] The watemnark detecting system 400 includes an amplitude normalizer 41 0, a transfomner 420, a partitioner 
430, segment-statistics calculator 440, a segment MAP decoder 450, a watemn ark-presence detemniner 460, a pre- 
senter 470, and a display 480. 

[01 01] The amplitude nomnalizer 41 0, the transfomrier 420, the partitioner 430, and the segment-statistics calculator 
440 of the watermark detecting system 400 of Fig. 4 function in a similar manner as similarly labeled components of 
15 the watermark embedding system 200 of Fig. 2. The exception is that the object of these components Is a "subject 
signal" rather than the original signal. A "subject signal" signal Is an unknown. It may or may not include a watennark. 
It may have been modified. 

[0102] For each segment, the segment MAP decoder 450 detemilnes a quantized value using the MAP decoding 
scheme. In general, MAP techniques involve finding (and possibly ranking by distance) ail objects (in this instance, 
20 quantized values) in temis of their distance from a "point." In this example, the "point" is the statistics calculated for a 
given segment. Nearest-neighbor decoding is one specific instance of MAP decoding. Those of ordinary skill in the art 
understand and appreciate MAP and nearest-neighbor techniques. 

[0103] In addition, thesegment MAP decoder 450 detennines a confidence factor based upon the distance between 
the quanitized values and the statistics calculated for a given segment. If they are coexistent, then factor will indicate 

25 a high degree of confidence. If they are distant, then it may indicate a low degree of confidence. Furthemiore, the 
decoder 450 combines the confidence factors of the segments to get an overall confidence factor. That combination 
may be most any statistical combination (e.g., addition, average,..niedian, standard deviation, etc.). 
[0104] The watermark-presence detemriiner 460 determines whether a watennark is present. The detenniner may 
use some distortion metric d{w, w) and some threshold T to decide if watermark is present or not. A normalized Hamming 

30 distance may be used. "• 

[01 05] The presenter 470 presents one of three indications: "watermark present," "watemnark not present," and '!uri- 
known." If the confidence factor is low, it may indicate "unknown." Iriiaddition, it may present the confidence-indication 
value. cai: 

[0106] This infomnation is presented on the display 480. Of course, this display may be any output device. It may 
35 also be a storage device. 

[0107] The functions of aforementioned components of the exemplary non-local QIM watemnark detecting system 
400 of Fig. 4 are explained in more detail below. 

Methodological Implementation of the Exemplary Non-Local QIM Watermark Detecting 

40 

[01 08] Fig. 5 shows the methodological implementation of the exemplary non-local QIM watemnark detecting system 
400 (or some portion thereof). More specifically, this figure shows the methodological implementation of watermark 
detecting of the exemplary non-local QIM watemnarker. This methodological implementation may be performed in 
software, hardware, or a combination thereof. 

45 [0109] At 510 of Fig. 5, the exemplary non-local QIM watemnarker normalizes the amplitude of the input. The input 
is an unknown specimen (i.e., signal) of a digital good. It is not known whether this signal includes a watermark or not. 
[0110] At 512, it finds a transfonn of the amplitude-nomnalized signal and gets significant frequency subband. That 
may be a low orthe lowest subband (e.g. , the DC subband) . Generally, the subband selected may be one that represents 
the signal is a manner that helps further robust watennarking and detection of the watermark. The lower frequency 

50 subbands are suitable because they tend to remain relatively invariant after signal perturbation. 

[0111] The result of this block is a transfonmed signal. When watermarking an image, an example of a suitable 
transfomnation is discrete wavelet transfomnation (DWT). When watemnarking an audio clip, an example of a suitable 
transfomnation is MCLT (Modulated Complex Lapped Transform). However, most any other similar transfomriatlon may 
be performed in alternative implementations. 

55 [01 12] At 514, the exemplary non-local QIM watemnarker partitions the transfomned signal into multiple, pseudoran- 
domly sized, pseudorandomly positioned, adjacent, non-contiguous segments. It uses the same secret key K is the 
seed for its pseudorandom number generation here. Therefore, this process generates the same segments as in the 
embedding process. 



9 



EP 1 253 784 A2 



[0113] For each segment of the signal, the exennpiary non-local QIM watemnarker repeats blocks 520 through 530. 
Thus, each segment Is processed in the same manner. 

[0114] At 522 of Fig. 5, the exemplary non-local QIM watemnarker finds statistics of the segment (e.g., averages 
within the segment). At 524, the exemplary non-local QIM watennarker finds decoded watemriark (or a portion thereof) 
5 using Maximum A Posteriori (MAP) decoding. An example of such a MAP decoding is nearest-neighbor decoding. 
[0115] At 526, it measures how close each decoded value is to a quanitized value and tracks such measurements. 
The data provided by such measurements may provide an indication of the confidence of a resulting watenriark-pres- 
ence detenni nation. 

[01 1 6] At 530, the process loops back to 520 for each unprocessed segment. If all segments have been processed, 

10 then it proceeds to 540. 

[0117] At 540 of Fig. 5, the exemplary non-local QIM watemnarker detemnines whether a watemnark is present. At 
542, it determines a confidence-Indication, which is based upon the tracked measurement data. 
[0118] At 544, based upon the watemnark-presence detemnination of block 540 and the confidence-indication of 
block 544, the exemplary non-local QIM watemnarker provides one of three indications: watemnark present, watermark 

15 not present, and unknown. In addition, it may present the confidence-indication value. 
[01 19] At 550, the process ends. 

Probability of False Alarms and Misses 

20 [0120] There is a relationship between Probability of false alanm (Pp), Probability of miss (P^^), and the average sizes 
of the segments. Pp is the probability of declaring that a watemnark is present even though it is not. P^ is the probability 
declaring that a watermark is not present although it is present indeed. Generally, the average segment size is relatively 
d/reccy proportional to the Pp, but it is relatively /nd/recf/y proportional to the P|y. 

[0121] For example, if the average segment-size is extremely small. So small that they are equivalent to the individual 
25 bits (e.g., equal to a pixel in an image. In that situation, watemnarks are embedded in single coefficients, which Is 
equivalent to the conventional schemes based on local characteristics. For such a case, Pp is very small and P^ is 
high. Conversely, if the average segment-size is extremely large. So large thatitus the maximum size of the signal (e. 
g., the whole image). In that situation, is presumably very low whereas Pp is high. 

30 Other Implementation Details 

/■■ 

10122] Forthe following descriptions of an implementation of the exemplary noriflocal QIM watennarker, assume the 
following: 

[0123] The input signal X is an image.. Of course, for signal may be other typestfor other implementations. However, 
35 for this example implementation, the signal is an image. Let jvbe the watemnark (a binary vector) to be embedded in 
Xand a random binary string Kbe the secret key. The output of a watemnark encoder, Xis the watemnarked image in 
which the infomnation vvis hidden via the secret key K. This image will possibly ujjdergo various attacks, yielding x A 
watermark decoder, given X and the secret key K outputs w. It is required that X and X are approximately the same 
for all practical purposes and that X is still of acceptable quality. The decoder uses some distortion metric d(w^ and 
40 some threshold Tto decide if watemnartc is present or not. The exemplary non-local QIM watemnarlcer use a nomnalized 
Hamming distance, which is the ratio of the usual Hamming distance and the length of the inputs. 

WM via Quantization 

45 [0124] The exemplary non-local QIM watennarker computes a vector ji by applying a forward transfomnatlon Tpon 
X. The exemplary non-local QIM watemnarker assumes that Xis a grayscale image; if not, a lineartransfomnation may 
be applied on a colored image to obtain the intensity image. (For colored images, most of the energy is concentrated 
iji the intensity plane). Once the infomnation hiding process is done via quantization, there is ^, and the watemnarked 
Xdata are obtained by applying the transform 7^ on ^. The exemplary non-local QIM watermarker randomizes the 

50 process using a random string derived from our secret key Kas a seed to a pseudo-random generator 

[0125] The scheme is generic. So most any transfomn may be used. In addition, Tp=(Tf^)-'^ need not be true, or even 
that their inverses exist. The exemplary non-local QIM watemnarker does not constrain the space where quantization 
occurs. The decoder applys the transfomn Tp-on the input, V, to get the output is ji^and applying approximate Maximum 
Likelihood (ML) estimation of the possibly embedded sequence Wy . Through a pseudo-random generator, Kwill de- 

55 tennine many randomization functions of the transform, quantization and estimation stages vvy. Once is found, it is 
compared with the embedded watemnark w, if the distance between them is close to 0 (or less than a threshold T), 
then it is declared that the watermark is present; otherwise not present. This contrasts with the natural measure for 
spread spectrum techniques that yields a high value of correlation if the watemnark is present 
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More Details of this Methodological Implementation 

[0126] The transforms Tpand help enhance robustness. For TpXo retain significant image characteristics, we 
may use discrete wavelet transfomnation (DWT) at the Initial stage. Next, semi-global (i.e., non-local) statistics of seg- 
5 ments are detemriined of the image. The local statistics are not robust. 

[0127] When the exemplary non-local QIMwatermarker computes, for example, the first order statistics of an original 
image signal and computes several attacked versions for random rectangles of fixed size. Then the average mean 
squared error between these statistics may be found. The error monotonically decays as the size of therectangles is 
increased. 

10 [01 28] In Tp, \i is set to be the estimated first order statistics of randomly chosen rectangles in the wavelet domain. 
Here Tp is not invertible if the number of rectangles is less than the number of coefficients. To choose 7^, one might 
first generate a pseudo-random sequence £ In the image domain that has the property to be visually approximately 
unnoticeable, pass it through Tp, find the corresponding statistics y^, compute the necessary scaling factors a such 
that the pseudorandom sequence £ scaled by a and added to X yields the averages \i that is quantized ^. This imple- 

is mentation uses randomly chosen non-overlapping rectangles. The exemplary non-local QIM watemnarker defines two 
quantizers, Qq and Q^, which map vectors in R"to some nearby chosen lattice points. 

[0129] Here is afonnal description. Define Qf:= {{qjj,Sij)\jGZ]\ q^BH^ to be reconstruction points for Q/, S/y care the 
corresponding quantization bins; /G{0,1} , y G Z . For each /, then So/^[(u;f^ySQj^)u(n^i;f)] = S^p[(Uf^^^f^)u(ui^Qf()] 
= 0. Here qQjqyeLte determined In a pseudo-random fashion (using Kas the seed of the random number generator) 

20 and n is the dimension of quantization. The exemplary non-loca! QIM watemiarker defines Q^la] - qQj^ a G. Sq/, and 
likewise for Q^. Both Qq and are derived from a single quantizer, Q, such that (a) the set of reconstmction points 
of Q is equal to {(?o/f/ «^{^?i>}; and (/?) for all jX min^^ rf^ [E{qQj) ,E(q^,)] = min,-^^i2[E(qo/), E(q^k)l Let ^ denote the 
common value (c) for each fixed /f, ^f^=rr\mj^f^i2[^i%p> ^iQok)^ = ^'^^J^k^Ld^i%)'^iQ^k)^ <f>/= (t>y > ^ for all /,/. Here 
is the L2 distortion metric, and E(.) is the expectation operator over the pseudo-random choices 

25 [0130] If, for example, n=1. The exemplary non-local QIM watermarker finds {E{qQj}} and {E(qy)} meeting the re- 
quirements mentioned above. Then randomization regions that are neighborhoods in around {E(Qo/)} and {E(qy)} 
... t'i, are introduced. Then {qo/1 and {qy] are randomly choose n from these regions using some suitable probability distribu- 

tions. The sizes of the randomizing regions and their shapes are input parameters. Let nR be the number of rectangles 
each indexed suitably. Let R be the length of the binary watemnark vector vvto be hidden in rectangles. For a vector, 

30 V denotes its Mh entry by v(/). Let L denote the number of levels of DWT that is applied. 

Encoding - ^^^^ 

[0131] Let A/be the number of pixels in Xands:=[Si,...,S;y,]bethevectorthatconsists of pixels of^sorted in ascending 
35 order. Create subvectors s^:= [s^...,Sj.] where t=round{N('\'p)y) and f^round{N{^ +P)y) and Sf^:=[s^sJ where u=round 

(A/[1-(1-p)Y])and u= round(Nl{'\+p)y]). Here round(i) equals the nearest integer to rand the system parameters 0<p, 

7«1 . Let m and Mbe the mean values of the elements of and respectively. Apply the point operator P[x] = 255 

* (x-'^yC^n?) to each element of X to get X' 

[0132] Find the Mevel DWT X. Let 2^ be its DC subband. 
40 [0133] Partition the into random non overlapping nR rectangles; calculate such that ^(/) is the mean value of 

the coefficients within rectangle /, i<nR. 

[0134] Lel\iJ:= [^(A7(/-1)+1),...,ii(n/-1),ii(A7/)],i^R. Use Qq and to quantize: for i<R, If = 0, quantize ^xl using Qq 
else quantize ^if using Q^. Concatenating the quantized we get ^. 

[0135] Find the differences between the original statistics and the quantized statistics: d=^-\i. 
^5 [01 36] Generate a pseudo-random sequence £=[p,;^ in the spatial (i.e. the original image) domain as follows: Choose 
p,y randomly and uniformly from {0,1} if Sf<Xfj<s^ where t'-roundiNy) and Ground (N(^-y)); otherwise set Pfj=0. Now 
apply L-level DWT to the matrix g, extract the DC subband of the output and call it . Now compute the corresponding 
statistics similar to the step 

[0137] Compute the scaling factors a such that a{/)= d{i)/\Lp{i),i<nR- 
50 [01 38] For each rectangle whose index is /, multiply all coefficients of within that rectangle by a(/), let the resulting 
vector be g^y.. 

[01 39] Apply inverse DWT on£^ ,let the output be p. ^ 
[01 40] Compute the watemriarked data: )C'=X+£. Apply the inverse of the point operator (see step 1) on X^ to get X. 

55 Decoding (input JQ: 

[0141] Similar to first part of the encoding above, find the con-esponding point operator on Y. Now apply the operator 
to /and to the output apply /_-level DWT, extract the DC subband and call it_V^. 
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[0142] Applying the partitioning procedure of the encoding above to Vand find its statistics ^ly. Let iiy{/) be the. Ah 
element 

[01 43] Using Qq and Q^, now is described how to carry out approximate ML estimation to find the decoded sequence 
Wy: Let 



10 [0144] For rectangles Indexed by n(h^)+^ ,..,,n/-1 ,n/, i^R, let /0(/) be the closest point to among reconstruction 
points of Qq, likewise iet r\(i) be the closest point to ^' among reconstruction points of Q^. If 



then assign Wy(/)=0; otherwise ]Vy(/)=1 . 

[0145] Compute tf(Wy,jv). If the result Is /ess than thresh old 7, declare that the watemnark was detected, or otherwise 
not present. 

20 

Exemplary Computing System and Environment 

[0146] Fig. 6 illustrates an example of a suitable computing environment 900 within which an exemplary non-iocal 
QiM watennarker, as described herein, may be implemented (either fully or partially). The computing environment 900 

25 may be utilized in the computer and network architectures described herein. 

[0147] The exemplary computing environment 900 is only one example of a computing environment and is not in- 
^..lended to suggest any limitation as to the scope of use or functionality of the computer and network architectures. 
Neither should the computing environment 900 be interpreted as having any dependency or requirement relating to 
any one or combination of components illustrated in the exemplary computing environment 900. s^i 

30 [0148] The exemplary non-local QIM watemnarker may be implemented with numerous other general purp'bse or 
special purpose computing system environments or configurations. Examples of well known computing systenps, en- 
^ vironments, and/or configurations that may be suitable for use include, but are not limited to, personal computers, 
server computers, thin clients, thick clients, hand-held or laptop devices, multiprocessor systems, microprocessor- 
based systems, set top boxes, programmable consumer electronics, ..network PCs, minicomputers, mainframe com- 

35 puters, distributed computing environments that Include any of the above systems or devices, and the like. 

[01 49] The exemplary non-local QIM watennarker may be described in the general context of computer-executable 
Instructions, such as program modules, being executed by a computer. Generally, program modules include routines, 
programs, objects, components, data structures, etc. that perfomi particular tasks or implement particular abstract data 
types. The exemplary non-local QIM watennarker may also be practiced in distributed computing environments where 

40 tasks are performed by remote processing devices that are linked through a communications network. In a distributed 
computing environment, program modules may be located in both local and remote computer storage media including 
memory storage devices. 

[01 50] The computing environment 900 includes a general-purpose computing device in the fomn of a computer 902. 
The components of computer 902 can Include, by are not limited to, one or more processors or processing units 904, 
^5 a system memory 906, and a system bus 908 that couples various system components including the processor 904 
to the system memory 906. 

[0151] The system bus 908 represents one or more of any of several types of bus structures, including a memory 
bus or memory controller, a peripheral bus, an accelerated graphics port, and a processor or local bus using any of a 
variety of bus architectures. By way of example, such architectures can include an Industry Standard Architecture (ISA) 
50 bus, a Micro Channel Architecture (MCA) bus, an Enhanced ISA (EISA) bus, a Video Electronics Standards Association 
(VESA) local bus, and a Peripheral Component Interconnects (PCI) bus also known as a Mezzanine bus. 
[0152] Computer 902 typically includes a variety of computer readable media. Such media can be any available 
media that is accessible, by computer 902 and includes both volatile and non-volatile media, removable and non- 
removable media. 

55 [01 53] The system memory 906 includes computer readable media in the fomn of volatile memory, such as random 
access memory (RAM) 910, and/or non-volatile memory, such as read only memory (ROM) 912. A basic input/output 
system (BIOS) 914, containing the basic routines that help to transfer infomnation between elements within computer 
902, such as during start-up, is stored in ROM 912. RAM 910 typically contains data and/or program modules that are 
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immediately accessible to and/or presently operated on by the processing unit 904. 

[01 54] Computer 902 may also include other removable/non-removable, volatile/n on -volatile computer storage me- 
dia. By way of example, Fig. 6 illustrates a hard disk drive 916 for reading from and writing to a non-removable, non- 
volatile magnetic media (not shown), a magnetic disk drive 91 8 for reading from and writing to a removable, non-volatile 

5 magnetic disk 920 (e.g., a "floppy disk"), and an optical disk drive 922 for reading from and/or writing to a removable, 
non-volatile optical disk 924 such as a CD-ROM, DVD-ROM, or other optical media. The hard disk drive 916, magnetic 
disk drive 918, and optical disk drive 922 are each connected to the system bus 908 by one or more data media 
interfaces 926. Alternatively, the hard disk drive 91 6, magnetic disk drive 91 8, and optical disk drive 922 can be con- 
nected to the system bus 908 by one or more interfaces (not shown). 

10 [01 55] The disk drives and their associated computer-readable media provide non-volatile storage of computer read- 
able instructions, data stnjctures, program modules, and other data for computer 902. Although the example illustrates 
a hard disk 916, a removable magnetic disk 920, and a removable optical disk 924, it is to be appreciated that other 
types of computer readable media which can store data that is accessible by a computer, such as magnetic cassettes 
or other magnetic storage devices, flash memory cards, CD-ROM, digital versatile disks (DVD) or other optical storage, 

15 random access memories (RAM), read only memories (ROM), electrically erasable programmable read-only memory 
(EEPROM), and the like, can also be utilized to implement the exemplary computing system and environment. 
[0156] Any number of program modules can be stored on the hard disk 916, magnetic disk 920, optical disk 924, 
ROM 91 2, and/or RAM 910, including by way of example, an operating system 926, one or more application programs 
928, other program modules 930, and program data 932. Each of such operating system 926, one or more application 

20 programs 928, other program modules 930, and program data 932 (or some combination thereof) may include an 
embodiment of an amplitude nomializer, a transfonner, a partitioner, a segment-statistics calculator, a segment quan- 
tizer, an delta-sequence finder, and a signal marker. 

[0157] A user can enter commands and infomnation into computer 902 via input devices such as a keyboard 934 

and a pointing device 936 (e.g., a "mouse"). Other input devices 938 (notshown specifically) may include a microphone, 
25 joystick, game pad, satellite dish, serial port, scanner, and/or the like. These and other input devices are connected to 

the processing unit 904 via input/output interfaces 940 that are coupled to the system bus 908, but may be connected 
^.!«.. by other interface and bus stnjctures, such as a parallel port, game port, or a universal serial bus (USB), r^. 

[0158] A monitor 942 or other type of display device can also be connected to the system bus 908 via an interface, 

such as a video adapter 944. In addition to the monitor 942, other output peripheral devices can include components 
30 H- such as speakers (not shown) and a printer 946 which can be connected to computer 902 via the input/output interfaces 
0 940. . ^ 

-fis [0159] Computer 902 can operate in a networked environment using logical connections to one or more remote 
'^z. computers, such as a remote computing device 948. By way of example, the remote computing device 94acan be a 

personal computer, portable computer, a server, a router, a network computer, a peer device or other common network 
35 node, and the like. The remote computing device 948 is illustrated as a portable computer that can include many or 

all of the elements and features described herein relative to computer 902. 

[01 60] Logical connections between computer 902 and the remote computer 948 are depicted as a local area network 
(LAN) 950 and a general wide area network (WAN) 952. Such networicing environments are commonplace in offices, 
enterprise-wide computer networks, Intranets, and the Internet. 

40 [0161] When implemented in a LAN networking environment, the computer 902 is connected to a local network 950 
via a network interface or adapter 954. When implemented in a WAN networking environment, the computer 902 
typically includes a modem 956 or other means for establishing communications over the wide network 952. The 
modem 956, which can be internal or extemal to computer 902, can be connected to the system bus 908 via the input/ 
output interfaces 940 or other appropriate mechanisms. It is to be appreciated that the illustrated network connections 

45 are exemplary and that other means of establishing communication link(s) between the computers 902 and 948 can 
be employed. 

[0162] In a networked environment, such as that illustrated with computing environment 900, program modules de- 
picted relative to the computer 902, or portions thereof, may be stored in a remote memory storage device. By way of 
example, remote application programs 958 reside on a memory device of remote computer 948, For purposes of 
50 illustration, application programs and other executable program components such as the operating system are Illus- 
trated herein as discrete blocks, although it is recognized that such programs and components reside at various times 
in different storage components of the computing device 902, and are executed by the data processor(s) of the com- 
puter. 

55 Computer-Executable Instructions 

[0163] An implementation of an exemplary non-local QIM watemnarker may be described in the general context of 
computer-executable instructions, such as program modules, executed by one or more computers or other devices. 
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Generally, program modules include routines, programs, objects, components, data structures, etc. that perform par- 
ticular tasks or implement particular abstract data types. Typically, the functionality of the program modules may be 
combined or distributed as desired in various embodiments. 

5 Exemplary Operating Environment 

,[0164] Fig, 6 Illustrates an example of a suitable operating environment 900 in which an exemplary non-locai QIM 
watermarker may be implemented. Specifically, the exemplary non-local QIM watermarker(s) described herein may 
be implemented (wholly or in part) by any program modules 928-930 and/or operating system 926 in Fig. 6 or a portion 
10 thereof. 

[0165] The operating environment is only an example of a suitable operating environment and is not intended to 
suggest any limitation as to the scope or use of functionality of the exemplary non-local QIM watennarker(s) described 
herein. Other well known computing systems, environments, and/or configurations that are suitable for use Include, 
but are not limited to, personal computers (PCs), server computers, hand-held or laptop devices, multiprocessor sys- 
15 terns, microprocessor-based systems, programmable consumer electronics, wireless phones and equipments, gener- 
al- and special-purpose appliances, application-specific integrated circuits (ASICs), network PCs, minicomputers, 
mainframe computers, distributed computing environments that include any of the above systems or devices, and the 
like. 

20 Computer Readable Media 

[0166] An implementation of an exemplary non-local QIM watemnarker may be stored on or transmitted across some 
form of computer readable media. Computer readable media can be any available media that can be accessed by a 
computer. By way of example, and not limitation, computer readable media may comprise "computer storage media" 

25 and "communications media." 

[01 67] "Computer storage media" include volatile and non-volatile, removable and non-removable media implement- 
ed in any,method or technology for storage of infomnation such as computer readable instructions, data structures, 
program modules, or other data. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash 
memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cas- ; 

30 settes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be 
used to store^the desired information and which can be accessed by a computer. a 
[01 68] VGdmmunication media" typically embodies computer readable instructions, data stmctures, program mod- 
ules, or otheivdata in a modulated data signal, such as carrier wave or other transport mechanism. Communication 
media also includes any infomnation delivery media. 

35 [01 69] The temn "modulated data signal" means a signal that has one or more of its characteristics set or changed 
in such a manner as to encode infonnation in the signal. By way of example, and not limitation, communication media 
includes wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, 
infrared, and other wireless media. Combinations of any of the above are also included within the scope of computer 
readable media. 

40 

Conclusion 

[01 70] Although the invention has been described in language specific to structural features and/or methodological 
steps, it is to be understood that the invention defined in the appended claims is not necessarily limited to the specific 
45 features or steps described. Rather, the specific features and steps are disclosed as prefen^ed fomns of implementing 
the claimed invention. 



Claims 

50 

1 . A method facilitating protection of digital signals, the method comprising: 

nomializing amplitude of a digital signal, wherein such signal is an original, unmarked signal; 
transforming the nomnalized signal; 
55 partitioning the normalized signal transform into segments; 

for one or more segments: 

• calculating statistics of a segment that are representative of that segment; 
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• quantizing such statistics of a segment; 

generating a delta-sequence representing a combination of the quantized statistics of the one or more seg- 
ments or an approximation of the combination; 
5 marl<ing the digital signal with the delta-sequence. 

2. A method as recited in claim 1 , wherein the partitioning comprises pseudorandomiy segmenting the normalized 
signal transform. 

10 3. A method as recited in claim 1 , wherein the partitioning comprises pseudorandomiy segmenting the normalized 
signal transfomn, wherein such segments are adjacent and non-contiguous. 

4. A method as recited in claim 1 , wherein the transfomning comprises finding a low frequency subband. 

15 5. A method as recited in claim 1 , wherein the transfonning comprises finding a significant frequency subband. 

6. A method as recited in claim 1 , wherein the statistics of the calculating comprises one or more finite order moments 
of a segment. 

20 7. A method as recited in claim 1 , wherein the generating comprises producing a pseudorandom delta-sequence that 
when combined with the digital signal approximate a combination of the digital signal and the quantized statistics 
of the one or more segments. 

8. A method as recited in claim 1 . wherein the mari<ing comprises embedding a watennark via quantization index 
25 modulation (QIM). 

.. . 9. A modulated signal generated in accordance with the;acts recited in claim 1 . . 

10. A computer-readable medium having computer-executable instmctions that, when executed by a computer, per- 
30 fomns the method as recited in claim 1 . ^' 

11 . A computer comprising one or more computer-readable media having computer-executable instructions that, when 
executed by the computer, perfonn the method as recited in claim 1 . 

35 12. A method facilitating protection of digital signals, the method comprising: 

nomrializing amplitude of a subject digital signal; 
transforming the nonnalized signal; 
partitioning the nonnalized signal transfonn into segments; 
40 for one or more segments: 

• calculating statistics of a segment that are representative of that segment; 

• quantizing such statistics of a segment to generated a quantized value of that segment; 

• measuring the distance between such statistics of a segment and the quantized value of that segment; 



45 



50 



55 



detennining whether a watermark is present in the digital signal based upon the quantized values of the one 
or more segments. 

13. A method as recited in claim 12, wherein measuring the distance comprising using perceptual distortion matrics. 

14. A method as recited in claim 12 further comprising: 

detennining an indication of confidence based upon the measured distances of the measuring; 
indicating an indication of confidence. 

15. A method as recited In claim 12 further comprising indicating whether a watennark is present. 

16. A method as recited in claim 12 further comprising indicating whether a watermark is present, wherein such indi- 
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cation is selected from a group consisting of "present," "not present," and "unknown ." 

17. A method as recited in claim 12, wherein the partitioning comprises pseudorandomly segmenting the nomnalized 
signal transform. 

5 

18. A method as recited in claim 12, wherein the partitioning comprises pseudorandomly segmenting the normalized 
signal transf omn, wherein such segments are adjacent and non-contiguous. 

19. A method as recited in claim 12, wherein the transfomning comprises finding a low frequency subband. 

10 

20. A method as recited in claim 12, wherein the transfonning comprises finding a significant frequency subband. 

21 . A method as recited in claim 1 2, wherein the statistics of the calculating comprises one or more finite order moments 
of a segment. 

15 

22. A method as recited in claim 12, wherein the determining comprises detecting a watemriark via quantization index 
modulation (QIM) techniques. 

23. A computer-readable medium having computer-executable instructions that, when executed by a computer, per- 
20 fomns the method as recited in claim 12. 

24. A computer comprising one or more computer-readable media having computer-executable instructions that, when 
executed by the computer, perform the method as recited in claim 12. 

25 25. A method facilitating protection of digital signals, the method comprising: 

partitioning a digital signal into segments; i^^. 
for one or more segments: 

30 • calculating statistics of a segment that are representative of that segment; 

• . quantizing such statistics of a segment; 

generating a mariced signal approximately equivalent to a combination of the digital signal and the combination 
of the quantized statistics of the one or more segments. 

35 

26. A method as recited in claim 25 further comprising nonnalizing amplitude of a digital signal, wherein such signal 
is an original, unmarked signal. 

27. A method as recited in claim 25 further comprising transfomning the signal. 

40 

28. A method as recited in claim 25, wherein the partitioning comprises pseudorandomly segmenting the signal. 

29. Amethod as recited in claim 25, wherein the partitioning comprises pseudorandomly segmenting the signal, where- 
in such segments are adjacent and non-contiguous. 

45 . 

30. Amethod as recited In claim25, wherein the statistics of the calculating comprises one or more finite order moments 
of a segment. 

31. A method as recited in claim 25 further comprising determining a delta-sequence that is representative of the 
50 combination of the quantized statistics of the one or more segments. 

32. A method as recited in claim 25 further comprising detenmining a pseudorandom delta-sequence that when com- 
bined with the digital signal approximate a combination of the digital signal and the quantized statistics of the one 
or more segments. 

55 

33. A method as recited in claim 25, wherein the generating comprises embedding a watemnark via quantization index 
modulation (QIM). 
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34. A modulated signal generated in accordance with the acts recited In claim 25. 

35. A computer-readable medium having computer-executable Instructions that, when executed by a computer, per- 
fomns the method as recited In claim 25. 

36. A computer comprising one or more computer-readable media having computer-executable instructions that, when 
executed by the computer, pert omn the method as recited in claim 25. 

37. A method facilitating protection of digital signals, the method comprising: 

partitioning a subject digital signal into segments; 
for one or more segments; 

• calculating statistics of a segment that are representative of that segment; 

• quantizing such statistics of a segment to generated a quantized value of that segment; 

determining whether a watemnark is present In the digital signal based upon the quantized values of the one 
or more segments. 

38. A method as recited in claim 37 further comprising: 

nomriallzing amplitude of the subject digital signal; 
transforming the normalized signal. 

39. A method as recited in claim 37 further comprising: 

for one or more segments, measuring the distance between such statistics of a segment and the quantized 
value of that segment; 

detennlning an indication of confidence based upon the measured distances of the measurlng;;=^ 
indicating an indication of confidence. ^- 

40. A method as recited In claim 37 further comprising indicating whether a watemnark Is present. t?. 

41 . A method as recited In claim 37 further comprising indicating whether a watemnark is present, wherein such Indi- 
cation Is selected from a group consisting of "present," "not present," and "unknown." 

42. A method as recited In claim 37, wherein the partitioning comprises pseu do randomly segmenting the signal. 

43. A method as recited in claim 37, wherein the partitioning comprises pseudorandomly segmenting the signal, where- 
in such segments are adjacent and non-contiguous. 

44. A method as recited in claim 37, wherein the statistics of the calculating comprises one or mo re finite order moments 
of a segment. 

45. A method as recited In claim 37, wherein the determining comprises detecting a watemnaric via quantization index 
modulation (QIM) techniques. 

46. A computer-readable medium having computer-executable instructions that, when executed by a computer, per- 
forms the method as recited In claim 37. 

47. A computer comprising one or more computer-readable media having computer-executable instm colons that, when 
executed by the computer, perfomn the method as recited in claim 37. 

48. A method for facilitating the protection of digital signals, the method comprising 

obtaining a digital signal; 
obtaining a watermark; 

using quantization index modulation (QIM), watermarking the signal with the watemnark, wherein such QIM is 
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based upon non-local characteristics of the signal. 

49. A method as recited In claim 48, wherein the non-local characteristics are representative characteristics of more 
than a single eiement of a signal. 

5 

.50. A method as recited in claim 48, wherein the non-local characteristics comprise statistics representative of one or 
more segments of the signal. 

51 . A method as recited in claim 48, wherein the non-local characteristics comprise statistics representative of one or 
10 more pseudorandomly sized segments of the signal. 

52. A method as recited in claim 48, wherein the non-local characteristics comprise statistics representative of one or 
more pseudorandomly dimensioned segments of the signal. 

15 53. A method as recited in claim 48, wherein the non-local characteristics comprise statistics representative of one or 
more pseudorandomly dimensioned segments of the signal, wherein such segments are adjacent and non-con- 
tiguous. 

54. A modulated signal generated in accordance with the acts recited in claim 48. 

20 

55. A modulated signal generated in accordance with the following acts: 

providing a server computer in a communications with a communications networic; 

receiving input from a client computer by way of the communications networic, the input providing a parameter 
25 indicative of a request for a modulated signal generated in accordance with the acts recited in claim 48; 

generating the modulated signal In accordance with the acts recited in claim 48; 

^sending the modulated signal via the communications network. .v. t6 

56. A computer-readable medium having computer-executable instnjctions that, when executed by a computer, per- 
30 fomhs the method as recited In claim 48. 

57. A computer comprising one or more computer-readable media having computer-executable instructions that, when^^ 
executed by the computer, perform the method as recited in claim 48. -v^ 

35 58. A method for facilitating the protection of digital signals, the method comprising 
obtaining a digital signal; 

using quantization index modulation (QIM), detecting whetherthe signal includes a watermark, wherein such 
QIM is based upon non-local characteristics of the signal. 

40 59. A method as recited in claim 58, wherein the non-local characteristics are representative characteristics of more 
than a single element of a signal. 

A method as recited in claim 58, wherein the non-local characteristics comprise statistics representative of one or 
more segments of the signal. 

A method as recited In claim 58, wherein the non-local characteristics comprise statistics representative of one or 
more pseudorandomly sized segments of the signal. 

62. A method as recited in claim 58, wherein the non-local characteristics comprise statistics representative of one or 
50 more pseudorandomly dimensioned segments of the signal. 

63. A method as recited in claim 58. wherein the non-local characteristics comprise statistics representative of one or 
more pseudorandomly dimensioned segments of the signal, wherein such segments are adjacent and non-con- 
tiguous. 

55 

64. A computer-readable medium having computer-executable Instructions that, when executed by a computer, per- 
fonns the method as recited in claim 58. 



60. 
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61. 
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65. A computer comprising one or more computer-readable media having computerrexecutable instmctionstliat, when 
executed by the computer, perform the method as recited in claim 58. 

66. A system for facilitating the protection of digital signals, the system comprising: 

a partitioner configured to segment a digital signal; 

a segment-statistics calculator configured to calculate statistics of a segment that are representative of that 
segment; 

a segment quantizer configured to quantize such statistics of a segment 

a signal marker configured to generate a marked signal approximately equivalent to a combination of the digital 
signal and the combination of the quantized statistics of the one or more segments. 

67. A system as recited in claim 66. wherein the partitioner is further configured to pseudorandomiy segmentthe signal. 

68. A system as recited in claim 66, wherein the partitioner is further configured to pseudorandomiy segmentthe signal, 
wherein such segments are adjacent and non-contiguous. 

69. A computer-readable medium having computer-executable instmctions that, when executed by a computer, per- 
forms the method comprising: 

obtaining a digital signal; 
obtaining a watennark; 

using quantization index modulation (QIM), watermarking the signal with the watermark, wherein such QIM Is 
based upon non-local characteristics of the signal and the non-local characteristics are representative char- 
acteristics of more than a single element of a signal. 

. 70. A computer- readable medium having computer-executable instructions that, when executed by a computer, per- 
forms the method comprising: 

f-. 

obtaining a digital signal; ^' 

using quantization index modulation (QIM), detecting whether the signal includes a watemnark, wherein such 
QIM is based upon non-local characteristics of the signal and the non-local characteristics are representative 
characteristics of more than a single element of a signal. 
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